DOCUMINT RI8UMI 



Se 006 292 



ED 028 089 

By*Nardlne» Frank E. 

Test Every Senior Project: Evidence of Cognitive Processes Related to Science. 

Educational Research Council of America^ Cleveland Ohio. 

Pub bate Feb 69 

Note* 2^; Paper presented at the National Association for Research in Science Teaching Conferencoi 
. Pasadeni^ California^ February 1969 
EORS Price MF-S0.25 HC-Sl.50 

Descriptors**Academic Achievement* Chemist^* ^Cognitive Processes* Cognitive Tests* College Bound 
Studmts* Comparative Analysis* *Plwsical Sciences* Physics* Scientific Concepts* Scientific Enterprise* 
* Secondary School Science* ^Student Characteristics* StudMt Evaluation 

Identifiers'Educational Research CouncU of America^ Processes of Science Test* Test Every Senior Project 

Reported is a study designed to evaluate differences in cognitive proc^ses 
related to science ainong (1) college bound high school students who h^ studied 
both physics and chemistry* (2) collie bound students who had not studied either 
subject* and (3) non-coliege bound students who had not studied either subject. The 
test used to assess the degree of understanding of scientific principles and methods 
of scienc e was the Processes of Science Test <P0ST). Group 1 su^ects 

demonstrated general competence in areas measured by PuST and were superior to 
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TEST EVERY SENIOR PROJECT: 

EVIDENCE OF COGNITIVE PROCESSES RELATED TO SCIENCE^ 

Frank E. Nardine 



In recognition of the increasing importance of science in our society, 
the Science Department of the Educational Research Council has as a prime 
goal the development of science curriculum for all students — science oriented, 
as well as non-science oriented. A major emphasis has been the study of 
those high school students who choose not to elect physics and chemistry. 

In part, the Test Every Senior Project was undertaken to ascertain the level 
of understanding of general scientific princi|des and reasoning ability possessed 

hy these students. 

Currently an escperimental curriculum entitled SCIENCE PROBLEMS 
is being developed in order to footer a greater interest in studying science 
in those high school students who choose not to elect advanced level science 
courses. The investigation reported is one aspect of our research conducted 
to better understand the non-science student in relation to the science oriented one. 

During a trial year of the SCIENCE PROBLEMS curriculum materials, 
the science staff observed that boys rather than girls generaUy elected to enroU 
in the course. Accordingly, male high school students were drawn from the 



^ The author wishes to tharic WiUiam V. Mayer and Wimbum L. Wallace for 
their cooperation in providing unpublished BSCS and POST reports. 
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Test Every Senior Project data bank (see Gallagher, 1969) and studied in 
relation to four independent variables: stated intention to attend college 
(henceforth referred to as college bound), stated intention not to attend 
college (henceforth referred to as non-college bound), course work in both 
physics and chemistry, and no course work in either fAysios or chemistry. 

The dependent variable was the Processes of Science Test (POST) score. 

POST was one of eight scales selected to be administered to approxi- 
mately 1,500 high school students or 1/8 of the Test Every Senior Project 
population. POST, known as the Impact Test in its early form, was developed 
as one phase of the BSCS evaluation program. 

The speoifio purpose of POST was to assess the degree of understanding 
of scientific principles and methods of science fostered by the BSCS curriculum 
materials. However, the test developers m a int ai n that POST is usefol in a 
more generic sense. In the POST manual (p. 3) it is stated: "Since the test 
was specifically prepared to appraise a student's understanding of gener^ 
scientifio principles and scientific reasoning abttity, it is also usefol for courses 
other than biology in which understanding of the processes of science is important. 
The menu*! forther states that: "Although the soiratific principles are framed in 
a setting of biological science, knowledge of biology is not a prereQuisite for 
scoring high on the test. " Specifically the concerns of the authors were with: 
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"dte methodology of aoieneo" 

"the bases tor Judging facts, prlnciplee, and conceprt" 

"the extent to which the student had developed standards 
for Judging or appraising data" 

"the student's ablU^ to Interpret qualitative and 
quantitative data" 

"Ithe atudent'el . . . aWll^ to screen and Judge the design 
of experiments** 

Further mo re, the test messuress 

"the of students to recognise adequate criteria 

tor accepting or rejecting hypotheses" 

and finally POST assesses the pupil's ability: 

♦♦to evaluate the general struoture of experimental design 
in soienee, including the need tor controls, repeatability, 
adequate sampUng, and oaretol measurements ** 

The oonoems of the authors of POST are in ooncert with the concerns 
and objectives of the Science Department of the Educational Besearch CounoiL 
Knowledge of the kind and degree of understanding measured by POST was 
expected to be usetol as a partial basis for revision and torther curriculum 
pUnnitig of SCIENCE PROBLElffl materials. 

Specifically, the questions asked in this study were: 

(1) Do oollege bound male higd^ school seniors with course work in 

physios and chemistry score significantly higher on POST than male 
coll ie bound seniors without oourse work in physios or chemistry? 
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(2) Do college bound male high school seniors with course work in 
physics and chemistry score significantly higher on POST than 
non-college bound males without course work in physics or chemistry? 

(3) Do college bound male high school seniors without course work in 
physics or chemistry score significantly higher on POST than non- 
college bound male high school seniors likewise without course work 
in physios or chemistry? 

(4) Does an inspection of each group's item response with its associated 
cognitive ability category reveal differences in general understanding? 

Subjects 

Of the 1, 512 high school seniors to whom POST was administered, 742 
high school males (see Table 1) comprised the pool from which the subjects 
for the present investigation were drawn: 

Group 1 consisting of college bound males wifii course work 
in physios and chemistry totaled 257 subjects. 

Group n consisting of oollege bound males without course work 

in either physios or chemistry totaled 121 subjects. 

Group m consisting of non^llege bound males without course work 



in either physios or chemistry totaled 86 subjects. 






The data collection procedures used In the Test Every Senior Project 
relied almost exclusively upon student response for obtaining personal data 
and other vital statlstlos. This methodology precluded obtaining I.Q, scores, 
particular course grades, and the like. The criteria for the olassifloatlon of 
male subjects Into the three groups almost assuredly separated them by ability. 
However, no direct test was possible to establish this fact. An analysis was 
made to ascertain what percentage In each group had taken a course In General 
Biology. The results Indicated that: 

99% of Group I (college bound students with course work In piqrslos 
and chemistry) had taken General Biology 

82% of Group n (college bound students without course work In either 
physios or chemistry) had taken General Biology 

80% of Group in (non-ooUege bound students widiout course work 
In physios or chemistry) had taken General Biology 

Thus, a vast majority of subjeots In this stu4y elected General Biology 
as a course of study and making the groups somewhat comparable in this respect. 

It Is quite evident from Table 1 that the test population of the Test Every 
Senior Project as represented by subjects to whom POST was administered does 
not represent a cross section of American high school pupils. For example, 

35% of the bqys elected both physios and chemistry and 85% Indicated Intentions 
to go to college. 
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Results 

The means and standard deviations of soores I6r the three groups on 
POST are shown in Table 2 . The first three hypotheses advanced considered 
the relationship of soienoe course woxk and college intentions. Since the 
evaluation of these hypotheses consisted of testing for the signifloanoe of the 
difference between Group I and n, Group I and in, and Group n and m. 
t tests^ were carried out. 

Hypothesis 1 predicted that college bound male high school seniors 
who have taken high school phystos and chemistry (Group I subjects) would 
score significantly higher on POST than college bound male seniors who 
have not have either of these courses (Group n subjects). The t value 
obtained indicated a significant differenoe in the predicted direction 
(t • 9. 19, df * 378, p • ^ .001). Group I subjects obtained higher soores 
than Group n subjects. 

Hypothesis 2 predioted that college bound male high school seniors 
with course work in physios and chemistry would score signilloantly higher 
on POST (Group I subjects) than male Ugh school seniors who had not elected 
either physics or chemistry (Group HI subjects). The resultant significant 
t value indicated that Group I subjects' POST scores were significantly higher 
than Group m's (t « 14.56, df ■ 241, p ^ .001). 



All p values are two-tailed. 



Hypothesis 3 predicted that college bound male high school seniors 
without course work in physics or chemistry (Group II subjects) would achieve 
significantly higher POST scores than non-college bound male high school 
seniors who hadn't taken either physics or chemistry (Group HI students). 

Hie t value obtained indicated that Group n subjects did achieve signifloantly 
higher POST scores than^d Group m subjects (t • 5.05, df * 205, p ^ .001). 

Hius, the first three hypotheses were confirmed. 

Question 4 asked if an inspection of each group's individual item 
responses and associated cognitive ability classitloation revealed differences 
in general understanding among the three groups. In other words, if die group 
mean scores were signiflcandy different from one anothei; an item by item 
analysis might indicate the command of soientiflo understanding and reasoning 
that a particular group had demonstrated by the POST performance. This kind 
of clinical analysis would have real utility in the classroom in that it offers a 
useftil interpreUtion snd application of the POST results for the educator. 

The first step in the analysis of individoal test items was to ascertain 
on what items the responses of the three groups were significantly different from 
one another. Chi square was em|dcyed to test the signifloanoe of the difference 
in response to each item between Qronp I and n. Group I and m, and Group n and m. 
The results are shown in Table 8. Responses of Group I subjects were significantly 
different from Group II subjects on 33 of the 40 POST items. Responses of 



Group I subjects were significantly different from Group ITT subjects on 38 of 
the 40 POST items. Responses of Group n subjects were significantly different 
from Group m subjects on 10 of the 40 POST items. Almost without exception. 
Group I subjects chose proportionately more of the correct item responses thu 
did Group n or Group m subjects. The only reversals occurred on items #6, 

#9, and #22, and only on item #9 was the difference significant. There were no 
reversals between Group n and Group m. In every instance. Group n subjects 
chose a significantly greater percent of correct responses than did Group in 
subjects. On only one question (#22) were no statistloal differences fcund 
between any of the three paired groups. Item #22 asked what subject matter 
training — (1) diemistiy only, (2) physios and chemistry only, (8) mathematios 
and physics only, or (4) chemistry, piqrsios, and mathematics — would assist 
a biologist to understand blood better. The item analysis data available from 
the test developers also showed an extremely low oorrelation between this item 
and total test score. 

The items to which more than 60% of subjects within each group responded 
incorrectly are presented in Table 4. More wrong-than-rigjht responses were 
m ade by Group I subjects on 4 items. More w ro ng- th an-right responses were 
m ad e by Group n subjects on 16 items. More wrong-than-right responses were 
m ad e by Group HI subjects on 27 items. There were no group reversals. 

That is, if more than 50% of Group I subjects missed a paitioular item, subjects 
in Group n and m did also; if more than half of Group n subjects responded 



incorrsctly to r psTtloulRr itoxn, Group m subjocts did likowise* 

In order to discern what cognitive patterns or trends were indicated 
by the significant differences that existed in item response among the three 
groups of subjects, the **BSCS Grid for Test Analysis** was utilised. Basically 
this grid classifies each individual test item according to cognitive processes 
or ability categories involved in answering the item correctly. Of the four 
major ability cat^jories detailed only three applied to POST. The headings 
for these categories are: 

A. Ability to recall and reorganise materials learned 

B. Ability to apply knowledge to new concrete situations 

C. Ability to use skills in understanding scientific problems. 

According to the grid classification system, 15 POST items fit most 
appropriately under Category A, 1 POST item fits most appropriately under 
Category B, and 24 items fit most appropriately under Category C. The entire 
grid can be found in Appendix A. A more extensive report of the BSCS grid and 
its development has been written by Klinckmann (1963). 

« 

The specific cognitive processes are indicated by the subcategories 
under each major category heading. The subcategories and the distribution of 
individual POST items are shown in Table 5. 



The criterion of more wrong-than-rlght reeponee was need as an 



tadlcatton of deflolenoy. According to this criterion Group 1 did not show a 
deHotenoy In «.y single category. None of the tour greater.thaa-60% - Incorrect 



response items came from the same category. 



and as with item #22, evidence 



suggests that Items #9. 19, and 20 had low correlation with total test score 
Thus these four Items provided little dlscrimlnatton between groups. 



those Items on which more than 60% of Group II and in subjects chose 

incorrect response are shmm to Thhle 6 and Tabte regard 

to Group n. It was tound that more than half of the group missed! 



2 out of 3 Items (or 67%) Involving screening hypotheses; 

4 out of 7 Items (or 67%) Involving methodology; 

2 out of 4 Items (or 60%) Involving Interpreting qualitative data; 

2 out of 4 Items (or 60%) Involving Interpreting quantttatlve data; 

2 out of 4 Items (or 60%) Involving understanding relevance of 
data to the problem; 

3 out of 8 Items (or 38%) Involving screening and Judging design 
of experimenta. 

Thus, a majority of subjects displayed deficiency to six of the POST 
categories. 



The deaclencles as Indicated by Group Hi's pertormance on POST are 

summarised to Table 7. More than half of Group in subjects missed; 
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4 out of 4 items (or 100%) involving interpreting qualitative data; 

6 out of 7 items (or 86%) involving methodology; 

3 out of 4 items (or 75%) involving understanding relevance of data 

to the problem; 

2 out of 3 items (or 67%) involving screening hypotheses; 

5 out of 8 items (or 62%) involving screening and judging design of 

experiments; 

2 out of 4 items (or 50%) involving interpreting quantitative data; 

3 out of 8 items (or 38%) involving criteria. 

i 

Thus, a majority of subjects displayed deficiency in seven of the POST 
categories. 

Ability categories B1 and C7 having to do with "non-quantitative 
knowledge" and "analysing scientific reports" respectively were not included 
in the Summaries of Group n and in as POST contains only one item for each 
category. This provision of a single item in a category was insufficient to 
allow meaningful interpretation. 



DISCUSSION 






The classification of actual POST items (Table 5) according to the 
BSCS Test Grid ability categories revealed a disproportionate number of 

A 

items among the several categories. Category A2-4, (criteria) and C3 
(screen and judge design of experiments) are represented 8 items each, 
while C4 (screen hypotheses) is represented ? items and B1 (non-quantitative 
knowledge) and C7 (analyze scientific reports) have but 1 test item each. This 
imbalance is regretable despite Klinckmann's (1963) explanation that items were 
classified according to ''maximum ability required" by the student. Her implication 
is that item imbalance is not present. In any case, if a single test item involves 
several abilities or cognitive processes, then it would be valuable to so specify 
as precisely as possible. The interested educator with his personal knowledge 
of the student would then be in a better position to evaluate the individual's 
performance. 

An attempt was made to have the professional staff of the Science Department 
of the Educational Research Council match items and categories. A great deal 
of disagreement resulted. Tbe reason for the disagreement was not that items 
could be multi-classified, thus making classification difficult. Rather, the problem 
encountered was that the category description of science processes was complex 
and highly sophisticated in comparison to specific test items. A more careful 
and detailed explanation of the categorization of each item in POST might have 
reduced disagreement. 
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Anyone who has been involved in test construction, and, specifically, 
item writing can attest to the fact that it is extremely difficult to classify the 
cognitive processes involved in learning. There is always the hazard of 
claiming to measure separate or distinct cognitive processes based on convention 
rather than fact. Yet despite the complexity and admitted failings of isolating 
and categorizing thought processes, the attempt of the POST authors to develop 
a test according to a cognitive schema is commendable. At the present time 
educators spend millions of dollars annually on testing programs without 
comparable benefits to the teaching-learning process accruing. Generally a 
composite test score merely indicates to the teacher that a student has mastered 
or failed to master the science material. Seldom do test results portray 
students' strengths and weaknesses and so reveal areas in which buttressing 
or shoring up of teaching effort can and should be concentrated. POST makes a 
real contribution to science education providing a framework which a 
student's composite numerical score can be broken down and analyzed in 
cognitive terms which have diagnostic value and implications. The BSCS Grid 
can serve as a valuable approach to test interpretation, for as Tyler (1968, p. 63) 
maintains: ". . . when we are trying to appraise the curriculum 1^ ascertaining 
how well the students are learning, we need information about those things that 
nearly all students are learning and those that very few are learning as well as 
those that are being learned by about half the class. " Further development and 
refinement of the BSCS Grid promises to make consequent testing a more meaningful 
tool for evaluation of science learning and understanding. 
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Certain conclusions can be drawn based on the findings of this 
investigation which may provide a basis for understanding the results of 
various science curriculums and for planning and developing new educational 
programs. The usual cautions against overgeneralization must apply, however, 
due to the restricted sample, all male subjects and the like. Specifically, it 
is possible to do a between group comparison as well as a within group comparison 
and arrive at an approximation of the student's grasp of certain cognitive processes. 
To illustrate. Group I subjects, college bound with course work in both physics 
and chemistry, demonstrated general competence in the areas measured by POST. 
As would be expected, these students who were motivated to enroll in the "difficult" 
courses and who had received all the science training generally offered to high 
school pupils, demonstrated relative superiority to students who had for some 
reason not enrolled in physios and chemistry. 

Group n subjects, college bound but without course work in either physics 
or chemistry, demonstrated competence in the areas of "criteria" (A2-4) and 
"screening and judging design of experiments" (C3). 

Group m subjects, non-college bound and without course work in physics 

I 

or chemistry, showed some degree of competence only in the area of "criteria" 
(A2-4). 

In comparing Groups n and m, it is possible to make determinations 
about the severity of cognitive deficiencies. For example, in terms of rank 
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ordering Group II is most deficient in "ability to screen hypotheses, " whereas 
Group m's greatest deficiency is "ability to interpret qualitative data. " The 
relative lack of significant differences between Group n and m indicates that, 
by and large, students without course work in physics and chemistry demonstrate 
the same general cognitive weaknesses or deficits whether from a college bound 
sample or not. With the Test Every Senior Project data bank, it will be possible 
to ascertain whether course work in physics or in chemistry contributes more 
toward a higher POST score, or whether both must be taken to overcome the 
cognitive lacks shown by Group n and III students. 

Benjamin Bloom (1968) has stated that within the various subject matter 
areas there ought to be a clear and definite specification of the expected level 
of leari^ which indicates mastery. The finding that over 50% of students in 
both Groups n and m were not able to answer correctly even half of the items 
in a hi^ percentage of categories demonstrates the necessity of following Bloom's 
advice. We need to press the enquiry into the skills and understandings which 
students are or are not learning. Furthermore, a variety of science courses 
needs to be developed to attract the non-science oriented high school student so 
that he will be exposed to the type of mental training a study of science offers. 
Educators and curriculum developers must approach the teaching-leaming 
process in science subject areas with an qye toward developing competence in 
the various processes of science which contribute to general overall mastery. 
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Likewise, those ei«aged in the development of testing and evaluation of 
programs and those involved in research in science education must continue to 
develop and refine instruments which will yield a meaningM chart or profile 
of a student»s progress in mastering the various aspects of the processes of 

science* 
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TABLE 1. 



PHYSICS AMD/OB CHEMISTBY COURSE WORK AND COLLEGE 
INTENTIONS OF 742 MALE HIGH SCHOOL SENIORS. 





Ftaysios 

ft 

^hemtstnr 


Physios 


Chemistry 


No Physios 
or 

Chemistry 


Other* 


Total 


CoUese bound 


257 


32 


171 


121 


47 


628 


Non-ooUm bound 


5 


4 


15 


86 


4 


114 



* Mooinplete data {mveated elaaaifleaUon 



TABLE 2. 



MEANS AND STANDARD DEVIATIONS OF SCORES ON 

processes of science test. 





N 


M 


SD 


3roupI 


257 


28.58 


5.95 


3roup n 


121 


22.00 


6.79 


Stoop m 


86 


17.40 


6.22 



TABLE 3. 



ITEMS ON WHICH OOBRECT RESPONSES WERE SIGNIFICANTLY DIFFERENT 
FROM ONE ANOTHER BETWEEN THE PAIRED GROUPS IN THE DIRECTION INDICATED. 



(HIOUPS 





I > n» 




n >ra 


1 




z 


Y 


2 




X 




3 


X 


z 


Y 


4 


z 


z 




5 


Y 


z 




6 




z 


X 


7 


Y 


z 




8 


Z 


z 




9 


Z* 






10 


X 


z 




11 


Z 


z 




12 


z 


z 


• 


13 


z 


z 


Y 


14 


z 


z 


X 


15 


z 


z 




16 


Y 


z 


X 


17 


Z 


z 




18 


Z 


z 




19 




X 




20 




z 




21 


Z 


z 




22 








23 


Z 


z 




24 


Y 


z 




25 




Y 




26 


Z 


z 




27 


Z 


z 




28 


Y 


X 


z 


29 


Z 


Y 


X 


30 


Y 


Y 




31 


Y 


Y 




32 


Z 


X 


Y 


33 


Z 


z 




34 


Y 


z 


Z 


35 


Y 


z 




36 


Z 


z 




37 


Z 


z 




38 


Z 


z 




39 


Z 


z 




40 


Y 


z 




X indtontee d 


»>.05 


Y indiettei D* >.01 


Z indtontee d ■ > .001 



* On Item #9 Group H eabjaete ehoM elgnifloantly more oorreet 
reeponeee In proportion to Group I eubjeote. 
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table 4. 



ITEMS ON WHICH MORE THAN 60% OF SUBJECTS WITHIN A 
GROUP RESPONDED INCORRECTLY. 

GROUP 




2 

3 

4 

5 

6 

7 

8 

9 

10 
11 
12 
18 

14 

15 

16 

17 

18 

19 

20 
21 
22 



X 



X 

X 

X 



X 

X 



X 



X 

X 

X 



X 

X 

X 

X 

X 



28 

24 

25 

26 

27 

28 
29 
80 
81 
82 
88 

84 

85 
36 
87 

38 

39 

40 



X 

X 

X 



X 



X 

X 

X 
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TABLE S 



Ability 

Category 



CLASSIFICATION OF POST ITEMS ACCORDING TO 
BSCS TEST GRID ABILITY CATEGORIES. 



POST ITEM NUMBER 



A2-4 


Criteria I 


3, 29, 31, 32, 33, 34, 36, 40 


A2-5 


Methodology 


2, 11, 20, 21, 26, 28, 30 


B1 


Non-quantitative I 

Knowledge I 


22 


Cl-1 


Interpret qualatitive I 

Data 


10, IS, 36, 38 


Cl-2 


Interpret quantitative 
Data 


4, 5, 12, 13 


C2 


Understand relevance 
1 of data to problem 


9, 18, 24, 37 


C3 


1 Screen and judge 

design of experiment 


1, 6, 7, 14, 16, 17, 19, 27 


C4 


Screen hypotheses 


23, 25, 39 


C7 


1 Analyze scientific 

reports 


8 
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TABLE 6. 



POST ITEMS CLASSIFIED BY ABILITY CATEGOBY ON WHICH 
MORE THAN 50% OF GROUP H SUBJECTS RESPONDED INCORRECTLY. 



Ability 

Category 


A2-4 

<8»* 


A2-S 

(7) 


B-1 

(1) 


Cl-1 


Cl-2 

W 


C2 

W 


C3 

(8) 


C4 

(3) 


C7 

(1) 






#20 


#22 


#36 


#12 


#9 


#14 


#25 




POST 




#21 




#36 


#13 


#24 


#17 


#39 




Items 




#26 










#19 










#30 




0 












Totals 


0 


4 


1 


2 


2 


2 


3 


2 


0 



* Maxtmiiin number of items wifliln the category 
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TABLE 7. 



POST ITEMS CLASSIFIED BY ABILITY CATEGORY ON WHICH MORE THAN 
50% OF GROUP HI SUBJECTS RESPONDED INCORRECTLY. 



Ability 

i^ateKory 


A2-4 

(81* 


A2-5 

(7) 


B-1 

|1) 


Cl-1 

(41 


Cl-2 

(4) 


C2 

W- 


C3 

(8) 


C4 

(3) 


C7 

(1) 




#3 


#11 


«22 


*10 


#12 


#9 


#1 


*25 


#8 




#29 


#20 




#15 


#13 


#18 


#6 


#39 




POST 


#34 


#21 




*36 




#24 


#14 






ptems 




#26 




#38 






#17 










#28 










#19 










#30 
















Totals 


3 


6 


1 


4 


2 


3 


5 


2 


1 



* Maximum number of items within the category 

a 



23 




APPENDIX A 



BSCS TEST GRID CATEGORIES^ 



^ Taken from BSCS NEWSLETTER. #19, September, 1963, 18-19. 
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BSC'S 'IVsl (Sriil Ciilogorirn 



A. ABILITY TO RECALL A REORGANIZE MATERIALS 
LEARNED.' This coloflory pnmcnly involves romcm- 
behnQ — cilhor l*y rccoQiiilKm or recoil -the inlofmo- 
tion which hos previously been studied It olso moy 
involve o simple problem, the key to which is being 
oble to recoil oil the informotion or detoils of mooning 
of ccftoin key terms in the problen> Items foiling into 
this cotogory con hove o high degree of rlifficulty either 
if they reguire romembcring o consideroble omount of 
informotion or if they require remembering o compli- 
coted kind of informotion such os o complex theory. 

Al. Memory of speeifles. * . * 

Al-1. Terminology. Memory of the referents for 
specific symbols. Exomples in biology ore 
cilio, nucleus, petiole, etc. This cotegory 
mriy olso include memory of the most gen- 
e -lly occepted symbol referent, or the 
vonefy of symbols which moy be used for 
o single referent, or the referent which is 
most oppropriote to o given use of o sym- 

bol. , , 

Al-2. Specific fncls. Events, persons, dotes, lw>- 
tions, descriptive chorocteristics, etc. This 
moy include very precise informotion — such 
gj the sue of o humon red blood cell" ■■■os 
well os opproximote informotion — such os 
the generol order of mognitude or relotivc 
size of different kinds of orgonisms. 

A2. Memory of woys ond moons of deoling wifh spo- 
dfict. This refers to knowing the woys of studying, 
orgoniring, judging ond criticizing which ore chor- 
octeristic of biologicol science. It includes such 
meons os the ordering of sequences, methods of 
investigotion ond stondords of judgment. These ore 
obstructions intermediote between specific informo- 
tion ond univcrsols. This cotegory docs not demond 
thot o student be oble to use these moteriols, but 
only thot he hove o possivc oworencss of their 
ruiture 

A2-I. Cnnventlonf, concoptuol moi’ ond heur- 
isHct. Memory of woys of trc..« ng ond pre- 
senting idcos ond phenomeno chorocteristic 
of biology. These ore the usoges, styles, 
proctices ond forms which best suit the pur- 
poses of the workers in the field or which 
seem to best suit the phenomeno which they 
study. They moy be orbitrory, occidentol 
or outhoritive, but often ore retoined bccouse 
of generol ogreement of individuols worki^ 
in the oreo. An cxomple would be o model 
of the DNA molecule. 

A2-2. Trends end sequences. Processes, movements 
ond directions of pficnomcno with respect 
to time. Exomples ore cmbryologicol devel- 
opment, mitosis. 

A2-3. Clessificetien end cetegeries. The 

sets ornl orrongements which ore regorded 
os fundomentol to o given purpose, orgu- 
ment, sultject or problem. E.g., phylogene- 
tic cotegorics, germ loyers, functionol cell 
types. 

A2-4. Ciitcrie. The Ihiscs for judging focts, princi- 
ples, conduct. Eg., Dorwm’s criterion for 
distinguishing more voriobic spccics from 
less vorioblv species. 

A2 5. Methedelety. Methods of investigotion, 
inquiry, techniques, technologicol devices 
orKj procedures used in the field of biology 
os well os employed in the studying of por- 
ticulor problems or phenomeno. E.g., the 
plot technique of ecology, the orgon-func- 
tion opprooch in physiology, speciol tcch- 
nologicol devices for studying living cells. 



ITIv Mil»Hal»-i;iitH--« «f A. urr <uiiin% fur tlu* iimst p.irt. *•' 
III lll•tli.ll•lill S, llliMiiii, iifi. fil., |t|t. 
limi mill t*Kuiiipli*s iNitiiii iit In liinkiuy ll•lv«• 



Agoin, It sluHiltf be stressed Ibot this cote- 
gory icfers to fomiliuiity with the method 
or technique, not obility to use it. 

A3. Memory of univcrsols ond obstructions in u field. 

These ore the mojor concepts, schemes ond pottems 
by which ideos ond phenomeno ore orgonized. 
These ore ot the highest level of obstroction ond 
include the theories ond structures which dominote 
o field ond ore generolly used in its study. 

A3-I. Principles, gcncroliiotions end concepts. The 
more porticulor obstroctions which wm- 
morize o group of phenomeno. E.g., princi- 
ples of enzyme octivity, concept of the gene, 
concept of noturol selection. 

A3-2. Theories, structures ond conccptuul schemes. 

A group of ' principles ond generolizotioiss 
olong with their interrclotions which consti- 
tute o rounded, systemotic view of o com- 
plex phenomenon, problem or field. These 
con be used to interrelote ond orgorsize o 
greet ronge of specifics. E.g., evolutionory 
theory on^ other BSCS themes. 

B. ABILITY TO APPLY KNOWLEDGE TO NEW CON- 
CRETE SITUATIONS. This entoils the obility to use 
remembered knowledge in o new, unfomilior or fictionol 
situotion. 

B I . Applicutien of nen-quuntitutive knowledfu. 

Applicotion of obstroctions to porticulor, concrete 
situotions. E.g , principles of food webs opplied to 
new, unfomilior or fictionol biotic communities. 
Principles ot the level of obstroction of A 2 ond 
A 3 ore likely to be used in this woy. 

B2. Applicutien of quuntitutivu muturiuls. Similor 
to Bl but the moteriols opplied ore quontitotive. 
E.g., use of quontitotive doto, opplicotion of prin- 
ciples of grophing, rotios, etc. 

C. ABILITY TO USE SKILLS INVOLVED IN UNDER- 
STANDING SCIENTIFIC PROBLEMS. (One woy to test 

both the loborotory moteriols ond these obilities is to 
develop items which poroHel, but ore rwt idunticol to, 
the investigotory loborotory exercises. The test items 
could present port of such on experiortcc ond irtvitu 
the sti^ent to complete it.) 

Cl-I. Interpret quulltutive dufu. This moy irtdude 
the following: 

o. The obility to tronslote, or porophrose« 0 
stotement o' doto. 

b. The obility to exploin or summorlie o stote- 
ment of doto. This involves some »rt of 
reordering or new view of the moteriol. It 
moy include the obility to drow the conclu- 
sion which fits the problem when presented 
with the description of on experiment ond 
the doto found. A vorlotion on this is to 
describe on experiment ond the conclusion 
drown, then osk whot sorts of doto must 
hove been found to justify such o conclu- 
sion. 

c The obility to extend o known principle to 
occount for doto which connot be occounted 
for by the known principle in its originol 
form. 

Cl -2. intepret quuntitutivu dutu (fruphs. luMus« 
churts). This moy include one or more of 
the following; 

a. The obility to tronslote, or provide o verbol 
description of, o toble or chort; conversion 
from toble to groph, etc. 

b. The obility to exploin or summorize grophs, 
tobies, etc. This moy entoil obility to dis- 
cern significonce of doto or to nnoke o 
choice between conclusions which ore more 
or less justified regording the doto pre- 
sented. 
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c. Intcrpololion and extrapolation. Intcrpolo* 
tion is the ability to derive ixirticular quan* 
titotive relations within a giveri series of 
observed particulars. Extrapolation is the 
ability to derive a particular relation by ex* 
tension of the observed series. This includes 
on understanding of the relative validity of 
extrapolation and interpolation. 

d. Discerning connections and interactions be* 
tween elements ond ports. A num^r of 
kinds of relationships ore used in biology. 
For quantitative doto these irKlude: expres- 
sion of graphic data in o mathematicol 
formula and deriving equations from por- 
ticular sets of doto; comporing porticulor 
sets of ^to with a generolizotion, e.g.. chi* 
squore; testing the fit of data to formuloe 
or equotions. 

C2. Undertfond felevonce of date le preMem. This 
moy include: 

0 . The ability to discern different degrees of ade- 
quacy of doto relative to a stated problem, 

b. The ability to understand "best" and "second- 
best" data, ond the reasons why the latter ore 
sometimes the only doto thot con be obtained. 

C3. Screen end ledge detfgn of expedmenH. Design* 

ing experiments involves development of a plon 
of work. It is obvious thot development of such 
plons is not required in obiectivo test items. 
Rather, a recognition of these plons or proposols 
is all thot is required. Such recognition includes 
understanding of on experiment's oppproprioteness 
relative to a stated problem. Recognition of ode* 
quote experimental design moy also require on 
understoisding of the concepts of control ond ode* 
quocy of somple. It moy involve discerning the 
kind of doto s^ich con be obtained from o given 
experiment. 

C4. Screen hypoHieses. This involves the obility to 
select one hypothesis from severol. Selection of 
the most oppropriote hypothesis moy be in terms 
of relevonce to the problem, to design of experi- 
ment, to doto collected, to feosibility of collect* 
irig doto, etc. 

CS. Identify pteblenis end nnnnswered questions. This 
moy include: 

o. Ability to reorgonize informotion moy result in 
identification of o new problem or question. 

b. Ability to diKem inconsistencies ond /or logical 
inoccurocies in known informotion moy suggest o 
new problem. 

c. Ability to discern biological problems growing out 
of certain orcos of relotionships in other disci- 
plines, such os physics, mothcrnotics or geology. 

C6. IdenMfy nsenmptiens end principles of inquiry nnd 
exle^ their npplientien end ec^. This irKludes 
the followirni abilities: 

o. Identification of the orgonizotionol principles of o 
scientific report, i.e., ormlysis of the^ systemotic 
orrongement ond logical structure which holds o 
report together. 

b. A^licotion of o prirtciple of inquiry, or o sot of 
prirKipIcs, to o new or unfomilor rescorch problem. 

c. Discerning of o set of assumptions or principles of 
inquiry which occount for the point of view or 
orgonizotionol structure of o report. This irKludes 
implicit assumptions ond prirKipIcs of inquiry of 
which the writer of the rc|XKt moy not be explic- 
itly oworc. 

d. Extension of the scope of principles of inquiry. 
This entails modification of o known priiKipIc of 
iri^iry orni provides o new one which is o more 
odequote bosis for opi>roaching new problems. For 
cxor^lc, rcgulotion con be considered on exten- 
sion of the principle of homeostasis. 



C7. Auolyie scientific mperfs. This irKludes: 

0. Idcritilicotiun of the elements irKludiKl in o re- 
search paper, e.g., the problem with which it deols, 
the experimental design, etc. 

b. Analysis of the relationships between these ele- 
ments and ports. 

c. Analysis of pervasive orgonizotionol prirKipIcs of 
scientific reports. 

d. Evaluation of scientific reports in terms of internal 
eviderKc, i.e., judgment or evaluation of o report 
on such grounds os logicol occurocy and consist* 
eiKy. 

e. Evoluotion of scientific reports in terms of external 
criteria, i.e., judgment or evaluation of o report on 
grouTKls extcrrKil to the report itself. The student 
might te expected to select from o nurnber of sets 
of criteria thot set most oppropriote to the report 
in question; or he moy be asked to remember 
criteria previously icorned. 

0. AIIUTY TO SHOW RELATIONSHIPS lETWEEN lOD- 
IIS OP KNOWLEDGE. This refers to relating different 
bodies of krwwlcdge loomed at different times or in 
connection with different topics orxi requires relating the 
given bodies of knowledge in ways other thon the ways 
in which they were related in text, lob or class work.' 
The obility sub-categories of this category ore defined 
in terms of different kinds of woys of relating the con- 
tent moteriol of biological knowledge: 

Dl. CuMpurbeu. This obility requires more than simp- 
ly recoiling ond controsting previously loomed in- 
formotion, os described in Category A. It requires 
being obie to compore ond contrast materials on 
points not previously loomed. This cotegory also 
includes discerning previously unknown relation- 
ships. 

D2. Ertropeletiea. This is the extension of trends, 
tendencies or generalizations beyorKf the given 
doto or phenorneno to determine implicotions, 
consequerKOS, effects, etc., which ore in occord- 
OTKO with the trend, tendirKy or generolizotion 
in ouestion. This cotegory iiKludes extrapolation 
in me brood sense of being oble to discern, for 
example, the significoiKe of o theory to future 
reseom rother thon exiropolation in the more 
limited sense of extension of trends expressed 
quontitotively, e.g., prediction of U.S. populotion 
1970. lotter would be clossified os Cl-2. 
D3«l. AppKce H ie te eeetlier W eleticel etee. Appli* 
ootion of cofKepts or models from one oreo of 
biology to phenorneno of onother oreo. One ex* 
omple is the notion of o "moleculor community." 
^bKiples ot the level of obstroction of A3 ore 
most likely to be used in this way. 

D3*2. AppllceHee te ether fis M s. For exomple, the 
op^iootion of ecologiool priiKiples to certain 
humon sociol problems. 

D4. Aoehfsls of leletieeships. Discerning new cortnec* 
Hons ond interactions between elements otkI 
ports. For exomple, discerning thot there moy be 
o relotively constont ratio between nucleor ortd 
cytoplosmic moteriols in different kinds of cells 
it this hos rx>t been previously pointed out in the 
text or clou discussion. AAoy include understorKf- 
ing the logicol relotions commonly called iiKluc- 
tkxi, deduction, onology, ond the dilfcrerKes in 
their looseness ornl precision. 
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new wey. Discerning ond evoluoting o rKw woy 
of organizing or reloting specifics within the field 
biology, ^g., the possible relotionship between 
DNA replication and certain virus-bocterio relo- 
tionships. 

D6. Pev ciepasa nt ef e set ef ehstrect releliens. The 
imogirwtive development of o new set of inter- 
rotated coiKepts. 



Ill is vrry ilifflnitt lo cuMUruct uMilliiilrH-lMNi'v ilt*Mi« wliM.-ti Utl Iw 
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